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I. INTRODUCTION 


A. PURPOSE 

This thesis will evaluate the Navy’s eurrent enlisted assignment ineentive pay 
program and its effect on retention in the Navy’s enlisted ranks. The objective of the 
analysis is to compare the current incentive program with alternate and possibly 
improved ways of conducting incentive programs. These analysis data could improve 
the cost effectiveness of the incentive program. 

The analysis will focus on experiments designed to evaluate the efficiency of 
alternative auction formats when auctions are used to determine individual assignments 
for one of several available jobs. In these assignment auctions, bids consisted of 
compensation requests and the subjects were presented with multiple jobs over which to 
bid. The structure of their bids will be compared across alternative rules for determining 
job assignments. 

The goal of this thesis is to analyze data from previously conducted auction 
experiments to determine if changes in the assignment incentive pay format could 
improve retention and cost effectiveness. The analysis will explore several auction 
design questions: how small a weight can be placed on the bid before the efficiency of 
the auction begins to degrade; does the type of auction chosen (i.e., first or second price 
sealed bid) impact the point at which a declining weight on the bid degrades efficiency of 
the auction; does the contention level impact auction efficiency; are there interaction 
effects between auction types and contention levels or bid weights? The analysis will 
empirically address these questions, using theoretical modeling, simulation modeling and 
advanced econometric analysis as appropriate and supported by the data and 
experimental design. 

B. BACKGROUND 

The Navy became an all volunteer force in 1973. After sailors finish their initial 
enlistment tour they must negotiate with detailers for their follow-on orders. The current 
job assignment system relies on a centralized, fairly static pay structure in which Sailors 
are largely paid according to their current rank, but little adjustment is made for hard-to- 
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fill locations or jobs. i Sometimes these orders are not desired by the Sailor or sometimes 
jobs went unfilled because the billet was unpopular. Added to the difficulty of the 
current assignment process is a robust and thriving private sector. The technical training 
received and experience gained by Sailors makes them highly marketable professionals 
for the private sector. This dichotomous correlation continues to present the Navy with 
retention problems, especially for those Sailors that have in-depth technical training and 
have completed their minimum service requirement. 

To combat this problem, the Navy, with Congressional authorization, started the 
Assignment Incentive Pay (AIP). AIP would be paid as a monthly stipend to attract 
Sailors to volunteer for hard-to-fill assignments. Although current incentives allow some 
flexibility for location-specific reenlistment bonuses, the fact that some jobs are often 
filled with involuntary assignments suggests that the current set of incentives lack the 
flexibility required to induce voluntary assignments to undesirable billets. An auction was 
determined to be the best method for distributing the AIP stipends to determine the least 
amount of money to pay to assign a qualified sailor to those hard-to-fill jobs. 

Navy enlistment and assignment quotas are driven by policy directives from the 
Chief of Naval Personnel in Millington, Tennessee. In determining the correct number of 
assignments, several factors have to be taken into consideration. For example, each sailor 
can only be assigned one billet even though the sailor may have placed bids on several 
assignments. The bid placed on the winning assignment not only affects that assignment 
but it affects the assignment of the other billets. Another issue in the assignment process 
is that the sailor’s bid is only one of several factors that will weigh in on the final 
selection. Other factors could include the Sailor’s dependents and if he meets the 
minimum qualifications for the billet. Analyzing the auction’s behavior and refining the 
metrics will allow the military chain of command to make more informed decisions in an 
increasingly cost conscious environment. As stated by the Admiral in charge of 

1 Golfin, Peggy, et all. “Evaluation of the Assignment Incentive Pay (AIP) 
System,” June 2004. 


2 



personnel distribution at the Navy’s Bureau of Personnel (BUPERS), “Our mission is to 
take eare of all Navy Officer and Enlisted personnel and their families, while meeting the 
personnel distribution needs of our Navy. We must assign all personnel in accordance 
with Navy directives and policies to meet both the needs of the Navy while striving to 
satisfy the professional and personal goals of the individual in a most responsive, 
courteous and service orientated manner’’2. With a thorough understanding of the auction 
format and metrics, forecasting can be developed to assist in improving the cost- 
effectiveness of the program and improving retention. 

C. RESEARCH QUESTIONS 

1. How small a weight can be placed on the bid before the efficiency of the 
auction begins to degrade? 

2. Does the type of auction chosen (i.e. first or second price sealed bid) 
impact the point at which a declining weight on the bid degrades efficiency of the 
auction? 

3. Does the contention level impact auction efficiency; are there interaction 
effects between auction types and contention levels or bid weights? 

D. SCOPE 

The scope of this thesis includes: (1) evaluating the Assignment Incentive Pay 
(AIP) program, (2) analyzing data from previously conducted auction experiments and 
(3) recommending improvements to the auction based metrics system in assignment 
planning. Other variables that could possibly affect assignments will not be considered 
within the scope of this study: economic conditions in the private sector, operational 
tempo, quality of the tour, quality of life, etc. 

Getting the right Sailor in the right job remains a high priority within the Navy’s 
chain of command. This is especially true with Sailors that have highly involved 
technical and computer training costs, such as Aegis Fire Control man, all nuclear ratings 
and Aviation electronics. The introduction of new programs, such as perform to serve, 
which is a mechanism that acts as a force shaping tool by leveling rating manning from 
overmanned to undermanned ratings and provides quality screening by controlling 

2 PERS 4 mission statement, Admirals Comer, Bureau of Navy Personnel Command website 
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reenlistments for all first term sailors, demonstrates this commitment. Previous trends 
and data analysis show that the largest numbers of sailors elect to leave active duty at the 
end of their first enlistment. Normally, financial incentives, such as Selective Re¬ 
enlistment Bonuses (SRB), are used to entice sailors to remain beyond their initial 
enlistment. 

The Navy receives significant benefits from sailors who remain in the service past 
their initial enlisted commitment. These benefits include decreases in future training 
costs, increased levels of knowledge beyond the initial enlistment and improved 
selectivity chances for senior ra nk with a larger pool from which to select. 

A cost analysis was not be performed in this study because the cost of past 
assignments are considered sunk costs at the end of their enlistment, regardless of 
whether Sailors decide to leave or remain on active duty. These costs include Boot 
Camp, “A” and “C” schools and any other additional training required for their rating. If 
Sailors decide to remain on active duty beyond their initial enlistment, that provides the 
Navy an opportunity cost of a salary deferred by their electing to do another tour. If not, 
a new cost would be incurred to train new sailors and the loss of experience of that sailor. 
This thesis pushes forward with the belief that if improvements are made in AIP, the 
results could significantly improve cost savings for the Navy. 

E. ORGANIZATION 

Chapter II provides an overview of the auction format and the Assignment 
Incentive Pay Program researched in this study. The assignment requirements and 
process are also discussed. Chapter III discusses the experiments and metrics that were 
used in the research. Chapter IV reviews the analysis and findings. Chapter V contains 
the conclusions and recommendations. 

F. SUMMARY 

The purpose of this thesis is to evaluate auction bids in the current Navy’s 
Assignment Incentive Pay program for enlisted sailors. Auction data used from 
previously conducted experiments are analyzed. The structures of their bids were 
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compared across alternative rules for determining job assignments. The seope of this 
study was limited to sailors eompeting and bidding for billets in the current AIP program. 
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II. AUCTION THEORY 


Auction theory centers on a market mechanism in which an object, service, or set 
of objects, is exchanged on the basis of bids submitted by participants. Auctions normally 
provide a specific set of rules that govern the procedure for the sale or purchase of an 
object to the participant with the most favorable bid. In his article “Vickrey Auctions in 
Practice: From Nineteenth Century Philately to Twenty-first Century E-commerce,” 
David Lucking-Reiley states, “In his seminal work on auction theory, William Vickery 
(1961) pointed out three types of auctions used in practice: the English ascending-bid 
auction, the (first-price) sealed-bid auction, and the Dutch declining- price auction”.3 

The English ascending-bid auction process occurs when an auctioneer directs 
participants to beat the current, standing bid. New bids increase the current bid by a 
predefined increment. The auction ends when no participant is willing to outbid the 
current standing bid. Then, the participant who placed the current bid is the winner and 
pays the amount bid. Therefore, the winner ends up paying a price that is equal to the 
second highest bidder’s value. In a first price sealed bid auction, the bidder who submits 
the highest bid is awarded the object being sold and pays a price equal to the amount bid. 
Finally the Dutch declining - price auction starts with a clock that initially indicates a 
price for the object for sale substantially higher than any bidder is likely to pay. Then, the 
clock gradually decreases the price until a bidder buzzes in or indicates his or her 
willingness to pay. The auction is then concluded and the winning bidder pays the 
amount reflected on the clock at the time he or she stopped the process by buzzing in. 

The Second Price Auction is an auction in which the bidder who submitted the 
highest bid wins the object being sold and pays a price equal to the second highest 
amount bid. Alternately, in a procurement auction, the winner is the bidder who submits 
the lowest bid, and is paid an amount equal to the next lowest submitted bid. Normally, 
second-price auctions are sealed-bid, in which bidders submit bids simultaneously; their 
results are equivalent to English auctions, in which bidders continue to raise each other's 

3 Lucking-Reiley, David Vickery Auctions in Practice: From Nineteenth Century Philately to Twenty- 
first Century E-commerce. Journal of Economic Perspectives, revised April 2000 
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bids until only one bidder remains. In Second Price Auctions, the strategy is to bid one's 
true value, the highest valued bidder is expected to win the auction and pay a price equal 
to the second highest value. Alternately, first price auctions award the object to the 
highest bidder, but the payment is equal to the amount bid. 

A. WHY THE NAVY CHOSE FIRST-PRICE AUCTION 

Despite the attractive properties of Vickery auctions (second-price auctions) are 
rarely seen in the business world because of susceptibility. Vickery auctions are scarce in 
the business world because of the bidder’s fear of truthful revelation of information to the 
third party or the fear of auctioneer cheating. In the course of our research, we have 
found that bidders (those who have participated in Vickery type auctions) fear that once 
they have submitted their maximum willingness to pay, the auctioneer has an incentive to 
cheat, inflate the second-highest bid or simply withdraw the item from the auction if a 
high bid signals that the good may be more valuable than originally thought. Therefore, 
this system is totally dependent on the auctioneer’s honesty. This information proves 
useful because if bidders fear that their sealed bids could be used against them, they will 
actually bid more conservatively. Therefore, Vickery auction bids are normally lower 
than those of first-price auction bids. 

In first-price and Dutch auctions, bidders tend to behave in the same way. So, it 
doesn’t matter which of these auctions a seller chooses nor does it matter whether the 
bidders have private values or share common values. The reason that a bidder behaves 
the same in both kinds of auctions is that they make the same decision and this decision is 
based upon the same information. In both auctions, a bidder knows that if they win they 
must pay exactly what they bid. They also know that they only win if their bid is higher 
than that of everyone else. The bidder must also decide upon their bid without knowing 
what others will do. The overall strategy for first-price auctions is difficult to specify 
because maximizing bid(s) depends on the actions of others. The tradeoff for the bidder 
is between bidding high and winning or bidding lower and receiving a higher profit if 
they win the auction. Theory of first-price auctions suggests that most bidders will shade 
their bids to move closer to the market consensus. This strategy will avoid what is know 
as the “winner’s curse.” 
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So, in order to assess the true impaet of the auction parameters on the bidding 
behavior of the subjects the Bid/Reservation Wage ratio for all the winning bids is 
calculated. The first price (low contention) auction is the most likely auction format to be 
implemented in the Navy. The recently implemented Assignment Incentive Pay (AIP) 
program is an example of a first-price auction. “AIP attempts to enhance combat 
readiness by permitting market forces to efficiently distribute Sailors where they are most 
needed.”4 The AIP program, eligibility requirements and process are discussed in the 
next section. 


4 CNO guidance 2005, “Status Report.” 
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III. ASSIGNMENT INCENTIVE PROGRAM 


A. BACKGROUND 

Readiness to meet any threat to the nation’s security is the primary mission of the 
United States Armed Forces during peacetime. Meeting the nation’s security needs 
requires an assured cadre of experienced professionals who can fill essential and non- 
essential positions (billets) throughout the services. The Navy has recognized that trained 
and ready forces provide the flexibility necessary to shape the global environment and 
deter potential foes. 

In 1973, the United States Navy moved from being a conscription force to being 
an all-volunteer force. Since 1973, sailors have entered the Navy as volunteers and have 
negotiated their orders through detailers (assignment coordinators). Unfortunately, the 
negotiation process doesn’t always reflect the desires of the Sailor (service member). 
The Navy has recognized that Sailors do not view all assignments as equally desirable. 
Sailors base their selection on several factors (e.g. geographic location, type of job or 
nature of duty), which play a critical role when negotiating with their detailer (assignment 
coordinator). It is these factors that make certain assignments in the Navy less desirable 
and difficult to fill. 

The Navy’s current distribution process attempts to fill these assignments 
regardless of desirability, but, because of the natural dynamics of the system, less 
desirable assignments are more difficult to provide sufficient manning. The Navy has 
implemented several different incentive programs to help fill less desirable assignments. 
For example, sailors are often offered guaranteed follow on orders (silver bullet) to their 
next assignment. This method ensures that if the Sailor agrees to accept a hard-fill 
assignment the sailor is guaranteed orders of his or her choosing after completing the 
assignment. Other incentives include promotion opportunities and monetary incentives 
(e.g. Special Duty Assignment Pay (SDAP), Location Selective Reenlistment Bonus 
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(LSRB), and or Hazardous Duty Pay-Location (HDP-L)).5 Regrettably, these incentives 
often to do not overcome the desirability issue(s) and often oppose the established sea 
and shore rotations. 

In June of 2003, the Navy began offering Assignment Incentive Pay (AIP) to 
alleviate shortages in hard-fdl assignments. AIP was initiated to “balanee the playing 
field” and “attempt to make all assignments desirable to at least one qualified 
volunteer.”6 The implementation of AIP would still result in some undesirable 
assignments but overall it would make all assignments more desirable to at least one 
qualified volunteer. Also, sinee AIP is designed to increase volunteerism for hard-fill 
assignments and loeations it should ultimately increase the sailors’ satisfaction and 
improve retention for all sailors who meet the Navy’s AIP eligibility requirements. 

B. ASSIGNMENT INCENTIVE PAY (AIP) PROGRAM 

AIP is a special pay authorized by Congress for USN/USNR enlisted active duty 
personnel (service members) serving in assignments designated by the respective Serviee 
Secretary. In the Navy, responsibility and poliey management is assigned to OPNAV 
N13 (Direetor Military Personnel Plans and Poliey Division). The AIP program is 
managed by a Distribution Incentives Board (DIB) which is comprised of representatives 
from the Fleet. Naval Personnel Command (COMNAVPERSCOM) and the Offiee of the 
Chief of Naval Operations (OPNAV) are designated to establish and provide guidanee on 
AIP praetiees and proeedures. They are also required to monitor the program and 
provide recommendations for maximum amounts and budgeting to N13. The 
Distribution Incentive Management System (DIMS) was developed to provide the 
managers (DIB, N130, and PERS 40) with a tool to aid them in effieiently administering 
the AIP program. DIMS is designed to track all AIP bidding activity and payments, 

5 Special Duty Assignment Pay (SDAP): available to service members who are assigned to billets 
authorized for SDAP, must meet eligibility requirements. SDAP is subject to Federal Withholding Tax but 
not FICA tax. Location Service Reenlistment Bonus (LSRB); an extension of the current Selective 
Reenlistment Bonus (SRB); available to service members who meet SRB requirements, subject to Federal 
Withholding Tax but not FICA tax. Flazardous Duty Pay-Location (HDP-L); available to service members 
who meet the specific requirements prescribed in DoD 7000. 14-R, Volume 7A, Section 2401; not subject 
to Federal Withholding Tax or FICA Tax. 

6 Jones, Michael, personal interview, 14 January 2005. 
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provide recommendations for maximum level changes, and provide budgeting forecasts. 
DIMS is designed to use activity manning trends along with bid activity to determine 
effective AIP levels. 

The Navy designates AIP- eligible assignments (jobs) and sets a maximum 
monetary incentive for each job, which, by law, must not exceed $1,500 a month. 
Originally, during the early stages of the AIP program, the Navy based the maximum 
monetary incentives on an assignment’s location and pay-grade. Since then, the Navy 
has included and offered higher incentives for certain types of assignments, particularly 
hard fill positions located overseas. Not all personnel assigned to an AIP location are 
eligible to receive AIP monthly payments. “Only personnel who have negotiated AIP 
assignments and are ordered to AIP locations after the implementation of the AIP 
program were entitled to receive monetary incentives.”^ 

C. ASSIGNMENT INCENTIVE PAY (AIP) ELIGIBILITY REQUIREMENTS 

AIP is designed to attract volunteers for assignments that have been traditionally 
difficult to fill. AIP can be used in place of or in conjunction with other monetary 
incentives to fill assignments designated as AIP hard-fill. Service members who wish to 
compete for AIP must be either U.S. Navy or U.S. Naval Reserve active- duty personnel. 
Also, the service member must be in a sea/shore rotation rating, qualified for the job 
requested, eligible for assignment in a “for duty” status and must apply for the 
assignment via Job Advertising and Selection System (JASS)[5'ee Appendix C. for JASS 
displays]. Additionally, service members on their initial tours are not eligible for AIP but 
they may compete after completing their initial tour. Furthermore, personnel who are 
designated “Fit for Duty” but unsuitable for “Operational Duty” will not be allowed or 
entitled to compete for the monetary incentives AIP offers. Moreover, this program is 

not available to SELRES, FTS, TAR, IRR and ADSW* personnel. In addition, personnel 

7 

* SELRES stands for Selected Reserve. 

FTS stands for Full Time Support 

TAR stands for Temporary Active Duty Reserve. 

IRR stands for Individual Ready Reserve. 

ADSW stands for Active Duty for Special Work. 
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who have been granted high year tenure (HYT) are not eligible for AIP. AIP is for those 
personnel who have been ordered to an authorized AIP location and are eligible to 
receive the entitlement. 

For those who are selected for the AIP assignment, the entitlement begins when 
the member reports to the activity for which the incentive was awarded. The entitlement 
continues until the member permanently detaches from the activity and is prorated for 
partial months. 

D. ASSIGNMENT INCENTIVE PAY (AIP) PROCESS 

Traditionally, enlisted detailers are responsible for meeting the assignment request 
from sailors and efficiently manning the world’s greatest Navy. Today’s Navy demands 
the highest quality and best trained sailors to maintain naval readiness. Detailers review 
each individual’s rotation window for enlisted personnel. This enables detailers to 
provide well-prepared sailors in proper numbers, on time (rotation) and in the most cost- 
effective ways possible. By effectively monitoring rotation windows, detailers are able to 
meet the Fleet’s dynamic manning requirements, provide contact reliefs for each gaining 
and losing command, and provide greater career opportunities for each sailor. Normally, 

enlisted service members are required to submit a NAVPERS 1306/63* form (Enlisted 
Duty Preference Form) upon completing six months of their current duty station. 
Detailers use this information to match all personnel assets to Navy-wide manning 
requirements and try to fulfdl the service member’s assignment desires. If the service 
member does not submit a duty preference form or regularly update it, they can be 
assigned to a Navy top-priority billet by their detailer. This assignment process does not 
consider the service member’s (non-volunteer) duty preferences and precludes any 
assignment negotiations between the detailer and the proposed service member. If 
detailers were continuously use this method of detailing it would have a negative affect 
on service member’s re-enlistments and the utility of the Navy’s human resources. 


* The enlisted service member must complete and submit NAVPERS 1306/63 in accordance with the 
Enlisted Transfer Manual (NAVPERS 15909G). 
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As it struggles to do more with less and meet the needs of its personnel, the Navy 
has undertaken an innovative approach to manning its ships with fewer hands on deck. 
Inspired by large commercial corporations which have attempted to improve their profit 
and productivity, the Navy has implemented its AIP system to better match qualified 
personnel to assignments, especially for assignments that have been historically difficult 
to fill (Navy top-priority billets). AIP is based on the principle of “supply and demand.’’^ 
A good example of this concept is that not every service member views each assignment 
equally. For example, location seems to be a determining factor in whether or not a 
service member accepts orders to a specific assignment. Sailor (A) may see a duty 
location as undesirable, sailor (B) views the duty location as desirable and sailor (C) may 
be indifferent about the location of the billet. The AIP system is designed to capture 
these differences and increase the probability of finding a volunteer to fill a hard-fill 
assignment. 

Applying for an AIP assignment is relatively easy. First, the sailor must use JASS 
when he or she is about nine months out from their scheduled permanent change of 
station (PCS). [Appendix A] Second, the sailor must review current and hot jobs 
available that have been designated as an AIP location. Third, if the sailor is interested in 
bidding for a particular billet he or she will bid in $50 increments for the position of 
choice. The range for bidding can be as low as $0 but may not exceed $1,500, which is 
the maximum congress has allowed for this monetary incentive program. Fourth, the 
sailor selects from the scroll down menu what he or she is willing to accept. All AIP 
incentive pay amounts will vary by location and position. Lastly, once all bids are in 
from all qualified personnel the detailer will make the final selection based on the range 
of qualified bids, PCS cost and any additional factors pertaining to each position. 
Generally, the qualified sailor with the lowest bid (total cost) is selected. Once the sailor 
is selected for an AIP assignment, he or she is issued PCS orders that include the AIP to 
which the sailor is entitled for that particular assignment. Upon receipt of these orders, 
the sailor signs an agreement and acknowledges the assignment location, duration and 
AIP amount to be accepted on a monthly basis. Although this type of electronic bidding 

8 Golfin, Peggy, et all. “Evaluation of the Assignment Incentive Pay (AIP) System,” June 2004 
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is only used for AIP authorized positions, it may one day become the Navy’s normal day- 
to-day detailing process for posting and assigning sea and shore based positions. 

E. ANALYSIS REVIEW 

In June 2004, the Center for Naval Analysis (CNA) evaluated the Navy’s AIP 
system. They examined many aspects of the AIP system, but this section of the paper 
will focus on IASS participation between various pay grades, fill rates, and effects of 
raising the cap per assignment. In addition, CNA recognized that when converting billets 
from Type 3 (sea duty) to Type 6 (overseas shore duty), AIP was very cost effective.^ 

All sailors have the choice of negotiating their next assignment with their detailer, 
but if they choose to apply for an AIP assignment they must use the Job Advertising and 
Selection System (JASS)io. JASS is a software application that is available on the Naval 
Personnel Command’s website for enlisted sailors to review and apply for available 
billets. Therefore, it is important to understand who has access to JASS, who uses JASS 
and examine whether the implementation of AIP has increased JASS usage. 
Accessibility to the JASS system is open to all sailors who desire to electronically detail 
their next assignment. Once on JASS, the sailor can view all billets posted on JASS or 
choose the AIP option if he or she is interested in an AIP assignment. A factor to 
consider when assessing JASS usage is the fact that some sailors are stationed overseas 
and subject to time zone differences. These time zone differences have no affect on the 
accessibility to JASS but do affect the accessibility to detailers. For example, if the sailor 
has a specific question about an AIP assignment he or she may be unable to contact their 
detailer. CNA stated that “the difficulty of sailors stationed overseas is not accessing 
JASS but in accessing a detailer on the phone.”ii Therefore, the only possible restriction 


9 For reference, Type 1 jobs are continental United States (CONUS) shore duty; Type 2 are CONUS 
sea duty; Type 3 are outside CONUS (OCONUS) shore jobs that are given sea duty credit; Type 4 are 
OCONUS sea duty; and Type 6 are OCONUS shore duty. 

10 JASS has been replaced by JCMS (JASS Career Management System). JCMS is designed to enable 
Sailors and Commands to identify the best job for the Sailor and best Sailor for the command. JCMS is 
designed to provide a bridge between existing legacy distribution systems and the Career Management 
System functionality of Sea Warrior. 

11 Golfin, Peggy, et all. “Evaluation of the Assignment Incentive Pay (AIP) System,” June 2004. 
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in accessibility to JASS would be a technical limitation that prevents sailors from 
uploading the JASS web site. 

CNA also discovered variations in JASS usage between pay grades. Their 
findings indicated that junior sailors have a tendency to use JASS more often than senior 
sailors. This variance is due to senior sailors feeling more comfortable speaking to their 
detailer when searching and negotiating for career enhancing orders vice accepting an 
AIP assignment that may not be career enhancing. Since detailers have direct control of 
the distribution process, senior sailors see that it is imperative for them to speak directly 
to their detailer when shaping their careers and family needs. 

Unfortunately, CNA was hampered in measuring JASS usage because of data 
limitations. Data limitations reflect the recent implementation of the AIP system. Since 
AIP was implemented in March 2004 and the CNA analysis was conducted and reported 
in June 2004, insufficient time had elapsed for CNA to collect enough numerical data to 
accurately assess JASS usage. Due to the data limitations, CNA was only able to analyze 
those sailors that had at least submitted one application on JASS. Therefore, insufficient 
data “limits our analysis because it means that we cannot identify the absolute level of 
JASS usage, and we can only evaluate relative differences in application rates across 
various Sailor characteristics or over time.”i2 Moreover, CNA was unable to extrapolate 
their findings to determine whether AIP assignments were undesirable or if differences 
existed between pay grades, ratings or duty type (sea/shore codes). The analysis did 
reveal that implementation of AIP effectively increased usage rates among the various 
pay grades and ratings but it was also evident (as mentioned above) that certain groups of 
Sailors preferred to be directly detailed vice applying on JASS. Understanding who has 
access to JASS, who uses JASS and if the implementation of AIP had increased JASS 
usage could assist detailers in meeting manning requirements. 

The readiness of this nation is solely based on the effectiveness of meeting 
manning requirements. Therefore, people and personnel are the single most important 
factors of military readiness and placing them in the right positions is imperative to the 

12 Golfin, Peggy, et all. “Evaluation of the Assignment Incentive Pay (AIP) System,” June 2004. 
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success of this nation’s security. Therefore, by allowing sailors to set their priees, 
through a bidding process for an assignment seleeted as a hard-fdl job or loeation will 
inerease fdl rate pereentages for those assignments eonsidered undesirable. There are 
many faetors that affeet the Navy’s ability to inerease fill rates for all eommands. For 
example, every pay grade and rating views loeations or jobs differently. Also, decreasing 
or increasing CAP* levels for speeific locations or jobs would have an overall affeet on 
fill rates. Furthermore, increasing fdl rates ean be eomplieated by other trade-offs or 
faetors, sueh as PCS funding availability, job availability for various pay grades or 
ratings and eligibility requirements. AIP is a fairly new program and because of its 
implementation there is a strong indieation that fdl rates have increased and will eontinue 
to inerease for locations and jobs authorized as AIP assignments. Unfortunately, sinee 
AIP had only been in existenee for 10 months when CNA conducted their analysis, it was 
diffieult to determine whether or not AIP had contributed to the inereased fdl rates. As 
more time elapses, AIP beeomes more popular and participation increases, there will be 
more complete data available to truly assess whether manning in AIP locations has 
increased beeause of AIP implementation. 

Earlier in this seetion we mentioned that raising the eap affeets the ability to 
inerease fdl rate pereentages. Raising the cap increases the probability of inereasing fdl 
rates because it induees an increase in applieation rate. For instance, CNA diseovered 
that when a cap was raised by $300 dollars there was a 52% increase in applications and 
a 115% increase in fdl rates. This is extremely important to the Navy beeause it 
“suggest[s] that the Navy could consider a eap increase when more applications or a 
higher fdl rate is required.” 13 This information ean be used strategieally to inerease 
manning levels for eommands that are historieally diffieult to fdl. The CNA’s analysis 
suggests that inereasing the cap ultimately increases the applieation pool of those 
interested and qualified for that particular assignment. “Raising the AIP eap allows eaeh 
sailor to find a job that best matches his or her preferences, until there is an optimal 

* For our purposes we define CAP as the maximum amount of monetary incentive the Navy is willing 
to pay for a specific billet in a designated location. 

13 Golfin, Peggy, et all. “Evaluation of the Assignment Incentive Pay (AIP) System,” June 2004, pg 

20 . 
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match of jobs and sailors, and no one is assigned involuntarily.”i4 In spite of this, the 
Navy must be careful when raising the cap that it doesn’t ereate gapped billets. This ean 
occur if there are more jobs than available sailors. By raising the cap it could create gaps 
in other locations which would ultimately lead to involuntary assignments. Also, the 
Navy must serutinize all raised eaps per location and job to ensure that it does not exeeed 
the eost-effeetiveness of AIP. 

The overall eost effeetiveness of AIP has been impressive. CNA rationalized that 
the AIP program was not only developed to inerease volunteerism but to begin 
eliminating Type 3 duty (sea duty) and replacing it with Type 6 duty (shore duty). 
Remember that sailors were offered shore duty billets with sea duty eredit (authorized sea 
pay) as an incentive to aceept hard-fill assignments. AIP allows the Navy the opportunity 
to convert 8,800 Type 3 billets into Type 6 billets. This eonversion enables the Navy to 
outsource the Type 6 billets and save an estimated $195 million dollars annually. Also, 
converting 8,800 positions into Type 6 billets inereases the sailors available for actual sea 
duty billets. Finally, the AIP program is a much more efficient ineentive than sea duty 
credit for overseas assignments. Analysis eonducted by the Center for Naval Analyses 
(CNA) revealed, “Using an effieient market system in whieh AIP is targeted by billet, the 
cost of getting volunteers for OCONUS (Overseas Continental United States) billets 
would probably be below $25 million annually. The sea duty credit (eosting $83 million 
annually at a minimum) is at least three times more costly than AIP. Even under a worst 
case scenario, assuming all OCONUS shore billets that receive sea duty eredit were paid 
AIP of $750 per month, AIP should be eost-effeetive.’’i5 As stated in an earlier seetion, 
the average AIP bid (generally about $350 a month) has been mueh less than $750 per 
month; aeeordingly CNA’s analysis understates the relative efficiency of AIP versus sea 
duty credit. 


14 Golfin, Peggy, et all. “Evaluation of the Assignment Incentive Pay (AIP) System,” 

June 2004, pg 24. 

15 CNA Report - Transforming the Assignment System: Will Incentives Reduce Critical Shortages? - 
CRM D0007147.A2, December 2002 
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r. 


SYNOPSIS 


Our analysis concludes that AIP has demonstrated significant benefits for the 
Navy’s personnel distribution system and it should continue to evolve as time elapses. 
AIP has proven that it can be an effective tool to persuade sailors to apply and accept 
hard-fill assignments. Thus, the Navy should continue to monitor and analyze sailor 
application behaviors. The Navy must focus on variations that may exist between various 
ratings and pay grades and the effects of raising and lowering the monetary incentive. 
These data will prove useful to the detailers in predicting which assignments will be 
difficult to fill and determining what measures must be taken to increase the probability 
of receiving at least one voluntary qualified sailor application. 

AIP allows the Navy the opportunity to convert positions from Type 3 to Type 6 
positions. This conversion (for OCONUS positions) will enable the Navy to save 
millions of dollars annually. Furthermore, as a result of the type duty conversion, the 
Navy will have an estimated 8,800 additional sailors available for sea duty assignments. 
Therefore, improving future readiness and providing more at sea training opportunities 
for sailors. Moreover, the research indicates that the effectiveness of AIP can be 
increased by adjusting cap rates methodically or by offering sailors lump-sum payments 
vice monthly incentives. 

AIP is in its infancy and it is far too early to fully assess the total utility of AIP. 
As time elapses and more data becomes available, we may discover that AIP has an 
overwhelming positive effect on retention and manning. Currently, data reflect that 
Sailor’s who are aware of or have directly participated in this new assignment initiative 
indicate that they are extremely supportive of the AIP program. “The AIP program is 
giving more Sailors a choice in their duty assignments and promises to increase the 
quality of life and career satisfaction of sailors and their families.”i6 

The importance of understanding the many factors (e.g. sailor characteristics, 
performance measurements, and measurements of effectiveness) that contribute to the 

16 Kelly, Mike, LCDR (N13). “Draft AIP Report to Congress.” E-mail to Michael.T.Jones@naw.mil . 
01 April 2005. 
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limitations and the success of AIP is that it will assist us in analyzing data from 
previously conducted auction experiments. The next section will explore several auction 
design questions and address issues and concerns surrounding the performance 
measurements for evaluating alternative auction formats employed in experimental 
analysis of the U. S. Navy’s Assignment Incentive Pay auctions. 
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IV. EXPERIMENTAL ANALYSIS 

A. GENERAL 

This study will analyze experiments to evaluate the efficiency of alternative 
auction formats when auctions are used to determine individual assignments for one of 
several available billets (jobs). In these assignment auctions, bids consist of 
compensation requests and the participants are presented with numerous billet 
opportunities on which to bid. The structure of their bids will be compared across 
alternative rules for determining billet assignment. 

B. INTENTIONS 

This effort will analyze data from previously conducted auction experiments. The 
analysis will explore several auction design questions: how small a weight can be placed 
on the bid before the efficiency of the auction begins to degrade; does the type of auction 
chosen (i.e. first or second price sealed bid) impact the point at which a declining weight 
on the bid degrades efficiency of the auction; does the contention level impact auction 
efficiency; are there interaction effects between auction types and contention levels or bid 
weights? The analysis will empirically address these questions, using theoretical 
modeling, simulation modeling and advanced econometric analysis as appropriate and 
supported by the data and experimental design. The final report will develop a 
theoretical model of bidding behavior with testable hypotheses, and provide preliminary 
results on these hypotheses. 

C. INSTRUCTIONS EOR THE EXPERIMENTAL AUCTION 

Instructions for the experimental auction are found in an appendix but are 
discussed here. Each participate (sailor) in the experiment made decisions in this 
experimental auction. There were 5 other participants (6 total) which were gathered as 
candidates to fill 5 fictitious jobs (billets) for low contention cases and 3 fictitious jobs 
for high contention cases. The decision to only use 6 participants in this study is because 
on average there is only a small group of “actual sailors” that compete for online billets. 
Whether or not they were selected for a particular billet in part depended on how 
qualified they were for the billet (as expressed by a fitness score randomly generated by 
the software) and how willing they were to take the job (as expressed by how low their 
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bid is for the billet). The greater the bid for a job, the more money the participant 
received if selected. On other hand, bidding high for a job made it less likely that they 
were selected for that job. Bidding high on all jobs made it more likely that the 
participant was unassigned. If not assigned to a billet, the participant did not earn any 
money in that auction and incurred a penalty of $0.30. 

Each participant’s “bids and profits in these auctions will be in terms of 
Gamebucks, converted into U.S. dollars at a rate of U.S. dollars/Gamebucks = 0.10. In 
other words, if the participant were to earn 10 Gamebucks in profit he or she would earn 
$1.00 in U.S. dollars.” Each participant is guaranteed $13 for participating in the 
experimental auction, but has the opportunity to earn more. 

1. C.l Data 

The data for evaluation were derived from an experiment conducted at several 
universities (University of Memphis, Southern Methodist University (SMU) and The 
University of Mississippi). The purpose of the experimental auction is to match Sailors 
to billets and “evaluate the comparative ability of alternative auction mechanisms to 
achieve effective labor assignment.”i7 The experiment lasted 60-90 minutes in duration 
and involved six participants (sailors) competing in a series of 20 auctions. Each auction 
was run in succession but independent of one another. Each sailor competed for either 
three of six billets in which they would be assigned to one of those billets based off of 
their maximum bid (reservation wage) and fitness score. Therefore, the winning bidders 
would be assigned to a billet and paid accordingly (their lowest acceptable bid). For each 
losing bidder, he or she will not be assigned to a billet and will not receive any payment. 
In each auction there will be either three or six winning bidders and three or one losing 
bidders. The following section introduces and explains the metrics to be used to measure 
auction effectiveness. 


17 Smith, James, L. “The Design of Experiments to measure and assess the efficiency of Alternative 
Assignment Auction Formats’’ September 2003, pg 1. 
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D. MEASURES OF AUCTION PERFORMANCE 


This section proposes performance measures for evaluating the alternative auction 
formats employed in experimental analysis of the U.S. Navy’s Assignment Incentive Pay 
auctions. In particular, we expand on “measures of auction effectiveness” put forward in 
“The Design of Experiments to Measure and Assess the Efficiency of Alternative 
Assignment Auction Formats” by James L. Smith (September 8, 2003).” 

The discussion is separated into the following sections: 

• Relevant notation 

• Understanding the “efficient outcome” 

• Normalization/indexing of performance measures 

• Analysis of specific performance measures 

E. RELEVANT NOTATION 

• Cijk = reservation wage of sailor i for billet j as assigned 

(randomly ex ante) for auction k 

• fijk fitness score of sailor i for billet j as assigned (randomly ex 

ante) for auction k 

• bijk = bid by sailor i for billet j during auction k 

• Smin = minimum allowed bid 

• Smax = maximum allowed bid 

• Sijk = salary/wage paid to sailor i for billet j as a result of auction 

k 

• Zijk = aggregate score of sailor i for billet j during auction k 

O — 100cx(l-bijk/Sniax)~^(l"Ct)fjk 

• Xyk = billet assignment identification function 

o = 1 if sailor i is assigned billet j during auction k 

o = 0 otherwise 
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F. UNDERSTANDING THE “EEFICIENT OUTCOME” 

1. Background 

a. The definition and nature of the “efficient outcome” is critically important 
in this discussion because almost all of the performance measures analyzed below use 
some measurement of performance at this outcome as a denominator or, more generally, 
as a way to index or scale the performance measures. 

b. The “efficient outcome” of the auction could be defined as the assignment 
and associated pay levels that would occur if all subject/sailor bids were replaced by true 
reservation wages, such that the “efficient score” of sailor i for billet j during auction k is 
given by 100a(l- Cijk/Smax)+(l-ct)fjk- However, it is not clear in what sense the above 
described outcome is “efficient.” The efficient outcome is traditionally defined as the 
outcome which maximizes total surplus. In this case, total surplus would be the sum of 
the surpluses enjoyed by each sailor (actual wage minus reservation wage for assigned 
billet) plus the surplus or utility of the Navy. It is not clear, however, that the above 
defined “efficient outcome” actually incorporates either sailor or Navy surplus/utility. 
There is certainly something appealing about the billet assignment that results from 
sailors bidding their true reservation wages (in the sense that it maximizes some type of 
“true” score), but we should be careful about calling this outcome “efficient.” Labeling 
the defined outcome as the “focal outcome” or “index outcome” or “baseline outcome” 
might be more appropriate. 

c. Obviously, an efficient outcome can only be defined if every party’s utility 
function (or surplus) is well-defined. Sailor utility is clear: actual wage minus reservation 
wage for assigned billet. Navy utility, however, is unclear. The Navy cares about both 
fitness scores and wages paid. At first, it may seem reasonable to define Navy utility 
from auction k as Zk which is the sum of the realized scores across sailors given by: 

(=1 j=\ 

This definition of Navy utility, however, is problematic for three main reasons: 
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Under the second price auction, sailor salaries are not equal to their bids, so 
perhaps the byk values in the formula above should be replaced by Syk values, because 
presumably the Navy’s utility function must incorporate actual salaries paid. This being 
the case, of course, begs the question of why aggregate scores are the same under the first 
and second price auction. 

If Navy utility is defined as Zk or some slight modification thereof, then the 
question of which value of a is optimal from the Navy’s perspective (one of the main 
proposed research questions) is a non-sequitur. The optimal value of a should be exactly 
the true value of a in the Navy’s utility function. Whereas it can be argued that the true 
value of a in the Navy’s utility function is unknown, this would make it impossible to 
identify the optimal outcome from the Navy’s perspective as well as impossible to define 
the efficient outcome, returning us to the original problem. 

If Navy utility is defined as Zk (or by Zk with byk in the formula replaced by Syk) 
and the sailor’s utility is defined as sp - Cyk, then each dollar of salary is worth 100a / 
Smax to the Navy while it is worth $1 to the sailor. Since 100a / Smax ^ 1 in all but knife- 
edge cases, total surplus is always increased by either paying all sailors an infinite salary 
(or whatever the upper bound is) or by compelling all sailors to take the lowest possible 
salary, even negative if that is possible. Obviously, these are unreasonable as “efficient 
outcomes’’ and, moreover, we would probably like to consider total efficiency 
independent of simple transfers of money. In other words, we would probably want a 
dollar to have the same value to all, even though this is commonly violated by varying 
wealth effects, risk aversion, opportunity costs, etc. 

That proper definition of the Navy’s utility function is not only important for 
identifying the “true’’ efficient outcome that maximizes total surplus, but also for 
identification of the optimal auction mechanism from the Navy’s perspective. It is clear 
ex ante that the performance measures described below will rank the various auctions 
quite differently, with some pairs of measures likely selecting diametrically opposed 
rankings. Thus, an overall Navy utility function would also allow for better weighing of 
alternative mechanisms. 
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We propose, therefore, that Navy utility from auction k be defined as Z* where: 

1=1 j=\ 

In other words, Z^= Zk with byk in the formula replaced by sp. To overcome the 

problem identified in point (2)(c) above, we propose that sailor i’s utility from auction k 
be defined as Uik where: 

j 

^ik = -Cijk)lsr^. ■ 

j=l 

In other words, Uik is simply sailor i’s surplus from his actual assignment j (Syk- 
Cijk) multiplied by lOOa/Smax, which scales his utility appropriately such that both sailors 
and the Navy value a dollar equally, eliminating “comer solution”, efficient outcomes 
involving infinitely positive or negative salaries. 

With utilities so defined, we can now define the tme efficient outcome(s) of 
auction k as the outcome(s) which maximizes total surplus TSk given by: 

rs.=z;+i;«,, 

i=l 

= Z Z (l /^max ) + (1 - «) 4 ) + Z Z 1 )/ ^max 

i=l 7=1 i=l 7=1 

= Z Z (l (l - /-^max ) + (1 - « ) 4 ) 

i=l 7=1 

This yields exactly the assignment that was originally proposed as part of the 
“efficient outcome,” (partially) rehabilitating the original concept. However, this 
“efficient outcome” is unique only in its assignment. After scaling sailor utilities, a dollar 
is now worth the same to the Navy as it is to any sailor. Therefore, any salary 
arrangement for the above defined assignment will be efficient: Total surplus is 
unaffected by simple transfers of money from the Navy to any sailor or vice versa. Thus, 
it is appropriate to refer to a unique “efficient assignmenf’ but not a unique “efficient 
outcome” where the notion of outcome includes a set of sailor salaries. 
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G. NORMALIZATION/INDEXING OF PERFORMANCE MEASURES 

1. Background 

a. All of the performance measures proposed here are normalized or indexed 
by dividing the gross measurement by a “baseline” measurement. 

b. Such normalization is presumably intended to (a) present the value of a 
measure relative to some well-understood “baseline” scenario and (b) facilitate 
comparisons of alternative auction mechanisms within and across different performance 
measures. 

c. Normalization of performance measures facilitates comparisons across 
different measures only when performance values have substantially the same meaning 
across measures. For example, if a high value is “good” in one measure a high value 
should be “good” in other measures as well whenever the normalizations are intended to 
facilitate cross-measure comparisons. Moreover, if some normalized measures are 
constrained between zero and one, they should all be simultaneously constrained. 
Without these consistencies it makes comparisons across measures very difficult. In the 
analysis below, we propose alternative normalizations that provide this consistency. 

H. ANALYSIS OF SPECIFIC PERFORMANCE MEASURES 

Measure name 

Total Wage Bill (WB) 

Quality to be measured 

The Navy’s total monetary cost of filling the available billets 

Discussion 

a. All else equal, a high value of WB is bad from the Navy’s perspective. 
This is important to consider when making comparisons with other performance 
measures where high values are good from the Navy’s perspective. 

b. In this analysis, total wage bill will be normalized by dividing by the total 
wage bill when (a) each sailor is paid his/her reservation wage, and (b) sailors are 
assigned to the available billets such that the lowest sum of reservation wages is 
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achieved. The index or baseline outcome in this case is the minimum-cost voluntary- 
participation outcome. This has the advantage of being both a feasible outcome and a 
true minimum achievable total wage bill. However, the total wage bill is likely to be 
significantly higher than the minimum cost voluntary-participation outcome, so this 
normalized measure would be greater than one. Inverting the measure (flipping the 
numerator and denominator) would add the additional normalizing feature of scaling all 
values between 0 and 1 with higher values being better from the Navy’s perspective. 

c. In sum, we propose the following wage bill performance measure for a 
given auction k: 




6 J 


2 —! 2 —! 


i=i j=i 


Where WB^ is the minimum-cost voluntary-participation total wage bill described 

above. 

Measure name 
Total Fitness Level (TF) 

Quality to be measured 

Extent to which Sailors are qualified for the billets to which they are assigned by 
the auction mechanism in force. 

Discussion 

a. As with the previous performance measure, it again seems appropriate to 
normalize a total fitness level performance measure by the maximum/minimum feasible 
value. Because “bigger is better’’ in this measure, the maximum feasible value seems 
appropriate, and it is very simple in any auction to identify the billet 
allocation/assignment that maximizes the sum of all fitness scores across assigned billets. 
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b. 

auction k: 


Thus, we propose the following performance measure of total fitness in 


6 J 




ijk ijk 


TF,= 


i=i j=i 


TFl 


Where TF,' is the maximum feasible total fitness as described above. 


Measure name 
Overall Score (OE) 

Quality to be measured 

Extent to which a particular mechanism achieves the ‘ideal’ value of the objective 
function. 


Mathematical formula 

6 7 20 

j-Tr_ 


Discussion 

a. This performance measure evaluates how well the auction “scored” 
relative to the maximum possible total score achievable, which is reached at the 
previously described “efficient outcome.” 

b. In this case, the use of the “efficient outcome” (z*) as a normalization is 
appropriate because this measure is about evaluating how close an auction comes to this 
outcome. Moreover, the measure appropriately normalizes values between 0 and 1 with 
higher values representing better performance. It is therefore comparable to all of the 
previous revised measures we have proposed. 
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Measure name 


Bidding Factor (BF) 

Quality to be measured 

Bid inflation relative to true reservation wages. 

Mathematical formula 


BF = 


6 y 20 

r=l J=\ 
6/20 


r=l j=l 

Discussion 


a. As opposed to other measures, this performance measure takes on values 
greater than one which is more appropriate in this context; moreover, all realized values 
of this measure are constrained to be no less than one (which is appealing). 

Summary 

The idea here is, of course, to establish a set of measures that enables the project 
team to accurately monitor and effectively analyze the assignment auction experiment. 
Once the metrics are gathered, the numbers can be used to formulate an overall 
conclusion about the overall bidding behavior and the effects of auction design. 

I. EXPERIMENTAL AUCTION RESULTS 

The auction data were derived from various experiments conducted at three 
separate universities at three different geographical areas with different proctors. 
However, the experimental data were consolidated and analyze as a whole. It is important 
to note that each university conducted their respective auction experiments using 
different fitness versus bid weights (F&B) weights than the other universities. As a result, 
the total data collected spanned six different F&B weight categories of F20/B80, 
F34/B66, F50/B50, F66/B34, F80/F20, F90/B10 and their decision variables of Overall 
Efficiency, Fitness, Wage Bill, and Bid Factor All. The Solver add-in function with a 

VBA macro within Microsoft Excel was used to optimize the efficiency assignments of 
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the numerical data derived from the experimental auction. Determining the optimal 
efficiency assignments for each variable and optimal weight within that variable allows 
the research group to determine what the most efficient auction format is for the Navy 
and sailor. For all intents and purposes, contention levels reflect actual supply demand 
balances and thus are not a realistic controllable variable for the Navy. The mean and 
standard deviation were determined to analyze common trends and compare various 
auctions overall efficiency. 

1. Fitness Score 

As the weight assignment is shifted from fitness to bid, the Fit efficiency 
increases across all variables. In each individual matrix. Fit increases from low to high 
contention and from fr* to price auction until F66/B34 where no specific pattern is 
recognized. The highest Fit outcome for each matrix is in the 2"*^ price auction field. 

The 2x2 matrix table, which displays the mean in the top portion of each section 
and the standard deviation in bottom portion, proposes that participants with high fitness 
scores, no matter what contention level or auction format have a high chance of being 
selected regardless of auction format or contention level will have a better opportunity for 
selection. The Navy’s goal directed by the Chief of Naval Operation (CNO) is to place 
“the right sailor in the right job at the right time’’ therefore, fitness score is integral in the 
auction process. As illustrated in figure 1.1 below, since the fitness score is relatively 
high across all weights, contentions, and formats; it can be ignored in lieu of the 
optimization of other variables. 
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20/80 


66/34 


Auction 



jst 

2nd 

Format 

Low 

0.953976997 

0.963171919 



0.02734416 

0.028533753 


High 

0.944963992 

0.959773445 



0.034633707 

0.027910498 


Contention 



34/66 


jst 

2nd 

Auction 

Format 

Low 

0.967363687 

0.972861878 



0.023369486 

0.023434986 


High 

0.969537233 

0.971342005 



0.033728847 

0.027125329 


Contention 



50/50 


ist 

2nd 

Auction 

Format 

Low 

0.973360891 

0.978479276 



0.026366621 

0.022677754 


High 

0.980403772 

0.984663121 



0.02854137 

0.018166006 



Contention 


Auction 



1st 

2nd 

Format 

Low 

0.989433098 

0.988383161 



0.013273796 

0.015317406 


High 

0.988148148 

0.993404861 



0.020343898 

0.013992291 


Contention 



80/20 


1st 

2nd 

Auction 

Format 

Low 

0.995208606 

0.995526473 



0.00750111 

0.00739069 


High 

0.993706601 

0.998863636 



0.011140481 

0.005016396 


Contention 



90/10 


1st 

2nd 

Auction 

Format 

Low 

0.999716312 

1 



0.001944867 

2.92283E-12 


High 

0.998611111 

1 



0.005240602 

L8647E-12 



Contention 


Figure 1.1. Fitness Score 


Navy Fit Efficiency 

1 

2 0.98 

3 
(0 
<0 

§ 0.96 

I 0.94 
o 

*3 

E 0.92 
0.9 

20/80 FIT 34/66 FIT 50/50 FIT 66/34 FIT 80/20 FIT 90/10 FIT 

Fitness/Bid Weight 

♦ 1 St High — 1 St Low —^— 2nd Hi ^ - 2nd Low 

Figure 1.2. Above illustrates the extent to which Sailors are qualified for the billets to 
which they are assigned by the auction mechanism in force. 
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2. Wage Bill 

The dominant trend seems to be that Wage Bill efficiency increases from 2"*^ to 1®' 
price auctions across all weights except for F66/B34 where 2“'^ price high contention 
outperformed 1®' price high contention. It also important to note that all 2“*^ price high 
contention auctions have high standard deviations indicating that Wage Bill outcomes 
vary significantly throughout the experiment. As a result, 1®‘price high contention across 
any weight seems to be the optimal choice. 

All else equal, a low efficiency value of WB is bad from the Navy’s standpoint. 
It is an indication of a higher premium the Navy must pay to fill a particular billet. This is 
essential to understand when comparing other performance measures. Figure 2.1 below, 
indicates that under the 1®‘ price high contention auction WB is lower than other formats. 
This is interesting because traditionally participants should bid their reservation wage in a 
2“*^ price auction. However, later results show this not to be the case. 


WB 

20/80 



ist 

2nd 

Auction 

Format 

Low 

0.67815842 

0.650098435 



0.089770733 

0.075335626 


High 

0.74624817 

0.620424754 



0.089770733 

0.099835619 


Contention 




34/66 



ist 

2nd 

Auction 

Format 

Low 

0.752624852 

0.583577816 



0.077859958 

0.086385579 


High 

0.807915132 

0.734893491 



0.100659912 

0.10375679 


Contention 



50/50 


ist 

2nd 

Auction 

Format 

Low 

0.632624501 

0.498516235 



0.064193095 

0.095996323 


High 

0.695907837 

0.613204789 



0.104193919 

0.112583691 



Contention 


66/34 



1st 

2nd 

Auction Format 

Low 

0.574137822 

0.488211134 



0.088510937 

0.049021166 


High 

0.683345996 

0.751321127 



0.067628718 

0.114430061 


Contention 




80/20 



1st 

2nd 

Auction Format 

Low 

0.614811825 

0.485031339 



0.060885109 

0.068849186 


High 

0.592927888 

0.509524058 



0.078101712 

0.129811729 


Contention 




90/10 



1st 

2nd 

Auction Format 

Low 

0.460264164 

0.369874755 



0.056826515 

0.063392137 


High 

0.507702614 

0.425885017 



0.106238159 

0.105623748 


Contention 




Figure 2.1. Wage Bill 
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Wage Bill Efficiency 



Fitness/Bid Weight 


1st High — ■-IstLow —^— 2nd Hi —• -2nd Low 


Figure 2.2. Above illustrates the minimum-cost voluntary-participation total 
wage bill described. 

3. Bid Factor All 

Bid Factor increases across all weights from high to low contention with the 
exception of F20/B80 1®‘ price auction. All weights, contentions, and auction formats 
have high standard deviations making this a hard variable from which to draw a 
conclusion. With the exception of F20/B80, 2"‘* price high contention seems to exhibit the 
least bid inflation. Under this performance measure values greater than one are most 
suitable for what it intends to calculate. Figure 3.1 below, supports the proposed “Bid 
Factor All” definition where the measure of “truthful revelation” is completely accurate. 
In the auction format used, participants are not being asked to reveal their reservation 
wage in these auctions but are simply being asked to submit a bid without going below 
their reservation wage. The bidding behavior of each participant can be drastically 
different. Each participant may bid at their reservation wage which may not exactly be 
“truthful” but more of a strategy in order to increase their position for selection. 
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20/80 


66/34 


Auction 



jst 

2nd 

Format 

Low 

1.444478498 

1.264809283 



0.080305394 

0.096247893 


High 

1.396474868 

1.37382961 



0.125254441 

0.178857512 


Contention 



34/66 


ist 

2nd 

Auction 

Format 

Low 

1.402723438 

1.458453515 



0.130680914 

0.20769989 


High 

1.153972663 

1.102241162 



0.124912706 

0.152769878 


Contention 



50/50 


ist 

2nd 

Auction 

Format 

Low 

1.498791486 

1.707696523 



0.0973209 

0.292597982 


High 

1.360335464 

1.305970752 



0.089770733 

0.154412536 



Contention 


Auction 



1st 

2nd 

Format 

Low 

1.634328373 

1.644515212 



0.194548402 

0.109368806 


High 

1.376459436 

0.993759892 



0.277899047 

0.107763949 


Contention 



80/20 


1st 

2nd 

Auction 

Format 

Low 

1.516084362 

1.543630511 



0.111934983 

0.14615091 


High 

1.441958113 

1.186202601 



0.161905549 

0.198241403 


Contention 



90/10 


1st 

2nd 

Auction 

Format 

Low 

1.956715355 

1.830009921 



0.112617194 

0.131647761 


High 

1.809776602 

1.313087522 



0.184094799 

0.215832082 



Contention 


Figure 3.1: Bid Factor All 


Bid Factor - All Bids 


2 
1.9 

2 1.8 
I 1-7 
^ 1.6 
> 1.5 
g 1.4 
.2 1.3 

S 1.2 
1.1 
1 

20/80 BFA 34/66 BFA 50/50 BFA 66/34 BFA 80/20 BFA 90/10 BFA 



Fitness/Bid Weight 


-1st High-All 1 st Low-All 


•2nd High-All —• -2nd Low-All 


Figure 3.2. Above illustrates the bid inflation relative to true reservation wages. 
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4. Overall Efficiency 

The dominant trend across all weights is that efficiency increases from high to 
low contention. Also all high contentions across all weights seem to have higher standard 
deviations than low contentions. High fitness, low bid weights with low contention 
appears to be the optimal choices for maximizing efficiency. 

In order to assess the impact on how small a weight can be placed on a bid before 
the efficiency of the auction begins to degrade we must optimize the auction data. As 
indicated in figure 4.1 below, the results clearly indicate that when analyzing first price 
auction/low contention, the Navy’s MOE and Sailor bid are much more efficient. The 
problem with second price auction is that while more bids are generated per billet there is 
no guarantee that the Navy could actually repeat the simulated larger pool of participants 
per available billet. 


20/80 



ist 

2nd 

Auction Format 

Low 

0.986416389 

0.983411961 



0.011958712 

0.017871456 


High 

0.683389996 

0.692360281 



0.056348801 

0.059707655 


Contention 




66/34 



IS. 

2nd 

Auction Format 

Low 

0.990423008 

0.990501466 



0.008245707 

0.009367461 


High 

0.770089012 

0.875767261 



0.093608355 

0.071506187 


Contention 



34/66 __ 

T’ 2nd Auction Format 


0.987940808 

0.710220971 

0.014317522 

0.062241708 

0.802374063 

0.786610927 

0.050217665 

0.066156076 


Contention 


80/20 _ 

1st 2nd Auction Format 


0.994126262 

0.990720968 

0.0054582 

0.007885964 

0.77686694 

0.839610234 

0.055226009 

0.054685731 


Contention 


50/50 90/10 



ist 

2nd 

Auction Format 



1st 

2nd 

Auction Format 

Low 

0.987805379 

0.982997801 



Low 

0.997687584 

0.997316195 



0.013633818 

0.013284818 




0.002566131 

0.003115958 


High 

0.769029666 

0.767559708 



High 

0.688101018 

0.846548521 



0.081475254 

0.053139311 




0.043953693 

0.075850121 


Contention 




Contention 



Figure 4.1. Overall Efficiency 
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Overall Efficiency 



Fitness/Bid Weight 


1st High —U - 1st Low A 2nd High — -2nd Low 


Figure 4.2. Above illustrates the extent to which a particular mechanism 
achieves the ‘ideal’ value of the objective function. 

J. CONCLUSION 

This paper has presented the affects of bid weight versus high/low contention and 
ist/ 2 nd auctions in an attempt to find levels of optimization for each variable to 
improve the quality of auctions for the purposes of Assignment Incentive Pay. In virtually 
all aspects, price auctions appear to be the most optimal, from the Navy’s perspective. 

The results clearly indicate that the Navy should not pursue second price auction 
and engage in a first price/low contention auction approach. Wage Bill is clearly 
optimized in a price auction and although there are certain weights for which Fitness is 
optimized in 2“^* price auction, by in large Fitness has no clear optimal auction choice 
over the other and therefore it can be assessed that a high fitness level will be maintained 
regardless of auction type selected. The “inefficiency” in bidding behavior displayed in 
Wage Bill contributes to low efficiency measures displayed in Bid Factor All for all high 
contentions. The Wage Bill results are interesting because they show that given rational 
parameters, some participants will still act irrationally. Furthermore, Overall Efficiency 
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displayed high efficiency for all low contentions which gives a strong indication that 
sufficient billets should be available to allow the auction mechanism many billet options 
when making assignments. 

Additionally, there are other considerations that must be taken into account. There 
are “a number of evaluation criteria used to analyze auctions and other economic 
mechanisms.” 18 The auction process end result should come together in an equilibrium 
(i.e. a solution in which neither the bidder nor seller wishes to change its position). 
Auction design must also consider the speed of reaching this equilibrium and ensure 
auction stability. 

Auction stability ensures that no subset of agents could have done better by 
coming to an agreement outside of the auction. Although all these criteria are important 
for the design of the auction process “the key criterion for the winner determination is, 
however, whether the solution to an allocation shows allocative efficiency.”!9 
Specifically, the rearrangement of resources could make someone better off without 
making someone else worse off. Furthermore, the Navy must determine its breakeven 
point at which the cost of auction assignment to voluntary assignment exceeds the 
benefits. It must determine the maximum amount of monetary incentive in comparison to 
its utility (this should include all enlisted ratings). What’s more, the Navy must address 
the cost effectiveness of outsourcing shore duty billets which will vary by billet and 
location. Finally, the Navy must determine its ultimate goal (i.e. fill rates comparable to 
all locations, best sailor for the command, lowest bid, application activity, maximum 
allowable incentive per billet or location, etc.). Answers to these questions are beyond 
the scope of this project, and we believe that they warrant further study. 


18 M. Bichler, The Future of eMarkets: Multi-Dimensional Market Mechanisms. Cambridge, UK: 
Cambridge University Press, 2001 (pg 73) 

19 M. Bichler, J. Kalagnanam, H. S. Lee and J. Lee, Winner Determination Algorithms for Electronic 
Auctions: A Framework Design. IBM T.J. Watson Research Center, IBM Systems Journal 2002. 
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APPENDIX A.. THE DESIGN OF EXPERIMENTS TO 
MEASURE AND ASSESS THE EFFICIENCY OF ALTERNATIVE 
ASSIGNMENT AUCTION FORMATS 


II. Auction Format 

A single experiment, which might take 60-90 minutes to complete, would consist 
of six subjects competing in a series of 20 auctions for either four or five available billets. 
Depending on the bids submitted and the rules of the auction, “winning bidders” m'e 
determined and assigned to available billets and paid accordingly. “Losing bidders” are 
awarded no billet and no pay (which represents burdensome downtime on the part of 
Sailors). There would be either four or five winning bidders, and one or two losing 
bidders each auction. 


Reservation Wages md Fitness Scores 

The 20 auctions within one experiment are conducted in succession, but 
independently of each other. At the beginning of every auction, each subject is informed 
of his “type” for that auction. A Sailor’s type consists of his reservation wages 
(willingness to accept the respective billets) mid fitness scores (qualifications for the 
respective billets). Each subject’s type is determined by random selection each auction 
from a predetermined set of reservations wages and fitness values—and this procedure is 
common knowledge among all subjects. The pre-determined reservation wages are 
represented by a 10x5 matrix of values, C, where columns represent the separate billets 
on offer (the fifth column would be suppressed in experiments where only four billets are 
available), and rows represent different sets of preferences regarding those billets. 


C = 


••• c 
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Thus, at the beginning of an auction, each subject is informed of his preferences, 
which correspond to a row selected at random (with replacement) from this matrix. Each 
subject is informed only of his own type, not the specific types assigned to others. 
However, all subjects know that the types of their rivals are drawn randomly from this 
same matrix. It would be advisable to present this matrix to the subjects, accompanied by 
the average of the ten possible values for each billet, which would allow each subject to 
quickly gauge how they might compare to their rivals: 


C = 




c 

^10,1 






c., 


The reservation wages actually assigned to respective subjects over all 20 
auctions can be represented by a 6x5x20 array: c = {c^k}, where / denotes the subject,/ 
the billet, and the auction. The entries in this matrix are determined once and for all, 
before any experiments are conducted, and then used over again in each experiment to 
impose the same design on each experiment. The auction mechanism will vary between 
experiments, but this design matrix of subjects’ reservation wages will not. 

The pre-determined fitness scores are represented by a similar 3x5 matrix of 
values, F, where columns represent the several billets on offer (the fifth column would be 
suppressed in experiments where only four billets are available), and rows represent 
subjects’ differing abilities (qualifications) to fill those billets. 



Revised September 8, 2003 
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Thus, at the beginning of an auction, each subject is informed of his 
qualifications, which correspond to a row selected at random (with replacement) from 
this matrix. Each subject is informed only of his own qualifications, not the specific 
qualifications assigned to others. However, all subjects know that the qualifications of 
their rivals are drawn randomly from this same matrix. It would be advisable to present 
this matrix to the subjects, accompanied by the average of the three possible values for 
each billet, which would allow each subject to quickly gauge how their qualifications 
might compare to their rivals: 


1 

•• 

^ 3 , ■ 

•• ^ 3 . 

F 

avg,l 

•• F 

mg,5 


The fitness scores actually assigned to respective subjects over all 20 auctions can 
be represented by a 6x5x20 array: f = {fi,j,k\, where / denotes the subject,/ the billet, and 
kihQ auction. The entries in this matrix are determined once and for all, before any 
experiments are conducted, and then used over again in each experiment to impose the 
same design on each experiment. The auction mechanism will vary between 
experiments, but this design matrix of subjects’ fitness scores will not. 

The elements of matrices C and F are to be determined by a procedure that 
controls the correlation between rows within each matrix. This permits the experimenter 
to govern the degree of similarity among Sailors. Moreover, the variance of the {Cj^} and 
{T/,} within columns (for each billet) should be of comparable magnitude (which will 
help to ensure that variations in both components of a Sailor’s combined score will be 
influential in the outcome of the auction). 

Revised September 8, 2003 4 
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Bidding Caps and Floors 


The Navy’s standard pay offer, Smin, constitutes the minimum bid that any subject 
may submit for any billet, and this value is chosen by the experimenter and made known 
to all subjects at the outset of an experiment. The standard pay level is not varied 
between auctions of an experiment or across billets. A decision for the experimenter is 
whether to set the standard pay level above the minimum of the {C^y}, in which case 
subjects would be prevented from bidding truthfully on those occasions when their 
assigned reservation wages are relatively low. 

The Navy’s bid cap, is the most any subject may bid for any billet, and this 
value is chosen by the experimenter and made known to all subjects at the outset of an 
experiment. Like the standard pay level, the bid cap is not varied between auctions of an 
experiment or across billets. If the bid cap is set below the maximum of the {Cy}, 
subjects would be prevented from bidding truthfully on those occasions when their 
assigned reservation wages are relatively high. 

The degree of inefficiency that potentially comes from caps and floors could be 
explored by conducting some experiments without the caps and floors in force, and 
comparing results to experiments where binding floors and caps are in force. Particular 
values of the caps and floors should not be set until values of the C, F, c, and f matrices 
have been determined. 


Revised September 8, 2003 
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III. Auction Mechanisms 


The auction mechanism, which is fixed throughout the 20 auctions of an 
experiment, consists of the rules that determine: (1) the assignment of subjects to billets, 
and (2) the pay awarded to each subject for the given assignment. 

Bids, Fitness Scores, and Aggregate Scores: 

In all experiments, subjects are directed to submit bids for each of the available 
billets. The bids submitted in a given experiment can be represented by {bijk}^ which 
represents the bid of subject i for billet J in auction k of the experiment. A subject’s 
“aggregate score” for each billet will be denoted by Zijk, and is computed as a linear 
combination of his bid and fitness score, according to the formula: 

Notice that bidding high relative to the maximum allowable bid tends to reduce 
the aggregate score; i.e., lower bids enhance the aggregate score just as higher fitness 
scores do. The value of parameter a controls the relative weight assigned to the two 
components of the aggregate score. If the experimenter sets «= 1/(1 + 100 then a 

one dollar reduction in bid has the same impact as one unit increase in fitness score.^ If 
the range over which reservation prices vary among subjects is the same as the range over 

This is determined by partial differentiation:-= 100a / , and: -= 1 - a . 

Equating these two partial derivatives and solving for a yields: a = -. For 

1+lOO/^m.x 

example, if the maximum allowable bid is given by Smax = 400, then a weight of a = 
1/(1+V4) = 80% must be attached to the bid component in order to make its influence on 
the aggregate score equal to that of the fitness score. 

Revised September 8, 2003 6 
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which fitness scores vary, then money bids and fitness scores will carry roughly equal 
weight in determining the outcome of the auction—assuming that Sailors bid truthfully. 
As noted previously, the values of matrices C and F and parameter a should be 
determined with this in mind. 

Determining the Assignment: 

The same criterion for assigning subjects to billets is used in all experiments; this 
part of the mechanism does not change. The criterion is simply to obtain the highest total 
of aggregate scores each auction, when summed across the available billets: 

6 J 

max:Z, = ’ 

i=l J=l 

where represents the given auction, and Xijk = 1 if subject i is assigned to billet j in 
auction k, otherwise Xijk = 0. The constraints are that no Sailor can be assigned to more 
than one billet, no billet can have more than one Sailor assigned to it, and Sailors who are 
unassigned are “left out” of the solution (awarded no billet and no pay for that auction). 

The “efficient outcome” of the auction provides a performance benchmark and is 
defined to be the assignment that maximizes the following objective function: 

6 J 

max:z; = 

i=l J=1 

where = 100a(l - )+ (l “ ■ This assignment differs from the actual 

assignment only in that the actual bids have been replaced by the subjects’ true 
reservation wages, Cijk. Notice that since the z*^ do not vary from experiment to 
experiment, neither do the efficient outcomes vary from experiment to experiment. 

Revised September 8, 2003 7 
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These calculations need to be performed only once and then reused each experiment, 
whereas the actual assignments must be calculated fresh in each experiment according to 
the bids that are submitted. 

Determining Pay Levels : 

First-Price Mechanism: Under the first-price mechanism, each subject who is 
assigned to a billet is paid for that auction the actual amount of his bid for the assigned 
billet. Actual pay levels, Stjk, for the respective subjects and billets in any auction can 
therefore be computed as: 

hji, = 

Note: because the assignment is made on the basis of the Zjjk, rather than the money bids 
alone, it is possible that the winner of a particular billet will not have tendered the lowest 
money bid. Under the first price mechanism, this has no impact on the actual pay level 
awarded to that subject, who receives the full amount of his bid regardless of whether it 
was the lowest. 

From the subject’s perspective, the net reward {riji^ earned from participation in 
the auction is given by the excess of actual pay over his reservation price for the assigned 
billet, riji^ — 

Second-Price Mechanism: Under the second-price mechanism, each subject who 
is assigned to a billet is paid for that auction an amount equal to the next higher money 
bid for that billet (if one exists), or s^ax —whichever is lower. Thus, given that a subject 
is assigned to a billet, his pay cannot be lower than the amount he bids, but could be 
higher. Bidding higher does not tend to raise the amount a subject would receive because 
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his pay level will be determined by the bids of others. On the contrary, bidding higher 
tends to reduce the amount a subject receives due to the greater probability that a high bid 
would cause the subject to remain unassigned. 

Regarding the pay of unassigned Sailors, awarding them zero reward, Sijk=0, 
already serves as a penalty sorts, compared to the reward they might have earned through 
assignment. However, it could be useful to further penalize the net reward offered to 
Sailors who are left unassigned. This is because, under the FP mechanism, any Sailor 
who bids truthfully (i.e., bijk=Cijk) and is assigned a billet would also receive a net reward 
of zero. (But note that truthful bidding is not rational behavior under the FP mechanism!) 
If this is a concern, the penalty for remaining unassigned could be elevated in the 
experiment by awarding all assigned Sailors some additional fixed amount of actual pay 
(assignment bonus) that is denied to unassigned Sailors. 

IV. Measures of Auction Effectiveness 

A variety of measures are needed to appraise the performance of a given auction 
mechanism. After each experiment has been completed, the following performance 
criteria can be evaluated: 


Consumer Surplus fCV): 

This index measures, for a given experiment, the extent to which subjects are paid 
more than their reservation wages for the billets to which they are assigned. Higher 
consumer surplus equates to happier Sailors, albeit at a monetary cost to the Navy. 


6 J 20 


6 J 20 , . 

where: ■ 


C*S = - 
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As is apparent, this formula measures the amount of consumer surplus relative to the 
consumer surplus that would be obtained at the efficient outcome (where the assignment 
and pay levels are recomputed after replacing bids with true reservation prices). The pay 
levels denoted by and are determined according to the rules of the mechanism in 

effect for the given experiment. Alternative benchmarks could be computed by replacing 
the denominator with other standards of comparison. For example, to get a sense of how 
much the particular weighting factor (a) affects auction performance, CS might be 
computed for the two polar cases defined by a = 0 (no weight given to Sailor 
preferences) and a = 1 (no weight given to fitness scores). These variations would 
indicate the relative “cost” or loss of performance that is caused by placing more or less 
weight on preferences vs. qualifications. 

Note: the shadow prices of the Vickrey-Leonard auction are not involved in this 
formula, but the denominator could be defined in terms of those prices as well, and the 
Vickrey-Leonard benchmark could be used either in addition to, or instead of, the wages 
determined by the actual mechanism in force. 

Total Wage Bill (IVB) : 

This index measures, for a given experiment, the Navy’s total monetary cost of 
filling the available billets. 

6 J 20 

WB = -. 

WB' 

The denominator is construed as in the previous case {CS) and again provides a 
benchmark. 
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Total Labor Cost (LC\ . 


This index measures, for a given experiment, the total burden placed on Sailors 
(regardless of how well they are compensated for it) taking into account only their 
preferences among alternative assignments. 

6 J 20 

Lc ^ ^=1 ;=i _ 

LC 

Total Fitness Level (TF) \ 

This index measures, for a given experiment, the extent to which Sailors are 
qualified for the billets to which they are assigned by the auction mechanism in force. 

6 J 20 

_ i=l J=1 ^=1 _ 

777 * 

Overall Efficiency fOEk 

This index measures, for a given experiment, the extent to which a particular 
mechanism achieves the “ideal” value of the objective function. If Sailors do bid 
truthfully under a given mechanism, then the efficient outcome will be achieved and the 
index will take on the value 1. 


OE = 


6 J 20 

i=l ;=1 ^=1 


OE" 
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Bidding Factor (BF) \ 


This is an indicator of systematic deviations from truthful revelation in bidding 
strategies. For a given experiment, it can be computed as a simple average as follows: 


BF = 


6 J 20 

j=i j=i t=i 

6 J 20 

i=l j=l /r=l 


or by plotting bids versus reservation prices and fitness scores for each experiment and 
computing the least squares regression line: 

PFijk + Pi fijk + ^ijk ’ 

where the estimated parameters define the bidding function, and the e^k 

represent the fitted errors relative to the estimated bidding function. Truthful disclosure 
would be represented by BF = 1; or by Pq = p 2 =^ and py = \. 


Mechanisms that vary significantly in terms of truthful disclosure would be 
expected to vary in terms of other performance measures, as well. 

V. Proposed Regime of Experiments/Treatments 
A complete factorial design that fully interacts all possible variables may be 
impractical—especially since two separate experiments of each treatment combination 
are recommended to ensure the validity of statistical results. Nonetheless, here follows a 
relatively comprehensive schedule of experiments that would afford a reasonable first 
examination of the impact of variations in auction design on performance. 
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Regarding bidding caps and floors, the following values are recommended for all 
experiments: = 0 and s^ax = ii^ax{Cy}, i.e., the cap is set at the highest possible 

reservation wage of any Sailor. This set of caps and floors constrains behavior in a 
meaningful way but does not interfere with any subject’s ability to bid truthfully, if 
desired. 


Proposed Experimental Regime 


Experiment 

Mechanism 

Balance 

Contention'^'^ 

1 

FP 

1/3 

Low (6/5) 

2 

FP 

1/3 

High (6/4) 

3 

SP 

1/3 

Low (6/5) 

4 

SP 

1/3 

High (6/4) 

5 

FP 

2/3 

Low (6/5) 

6 

FP 

2/3 

High (6/4) 

7 

SP 

2/3 

Low (6/5) 

8 

SP 

2/3 

High (6/4) 


The “balance” refers to relative influence of Sailor bids vs. fitness scores, and is 
achieved by setting parameter a to put the two partial derivatives (see page 6) in the 
indicated ratio, either 1:3 or 2:3. 

Low” contention is achieved by having 6 subjects compete for 5 billets. “High” 
contention is achieved by having 6 subjects compete for 4 billets. 
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APPENDIX B. INSTRUCTIONS FOR AUCTION EXPERIMENTS 


Introduction 

You are about to participate in an experiment in which you will make decisions in 
an auction. Several auctions will be conducted but the exact number is unknown. You 
and 5 other participants (6 total) are gathered as candidates to fill 5 fictitious jobs. 
Whether or not you are selected for a particular job will in part depend on how qualified 
you are for the job (as expressed by a fitness score randomly generated by the software) 
and how willing you are to take the job (as expressed by how low your bid is for the job). 
The greater your bid for a job, the more money you will receive if you are selected for it. 
On other hand, bidding high for a job makes it less likely that the software will select you 
for that job. Bidding high on all jobs makes it more likely that you will be unassigned. 
Being unassigned means that not only do you not earn any money in that auction but you 
will also incur a penalty of $0.30. Exactly how your bids affect your assignment is 
explained below. Your task is to select a bid for a series of jobs. 

We will first conduct a short experiment that does not involve monetary payouts 
so that you may first familiarize yourself with the procedure. 

Your bids and profit in these auctions will be in terms of Gamebucks but you can 
convert them into U.S. Dollars at a rate of U.S. Dollars/Gamebuck = 0.10. In other 
words, if you were to earn 10 Gamebucks in profit you would earn $1.00 in U.S. Dollars. 
Any profits earned will be yours to keep. 

For your participation today you are guaranteed to leave this room with no less 
than $13, but you may earn more. 
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How to Bid on Jobs in the Auction 


In the lower left hand box of Sereen 1 you will see 5 jobs (i.e. Job 1, Job 2, Job 3, 
Job 4, and Job 5) on whieh you will bid. For example, to bid on Job 1 eliek on the row 
starting with Job 1. This will cause the bid calculator pop-up to appear as in Screen 2. 


Screen 1 



56 



























































Screen 2 



io 





|i^ Done I I I 1^ Local intranet 

|^Start| | I I I [^C:\ANi...| ^5l:artD...| ^DIS-... | |^JIS-... ^JI5HO...| g|JI5HO...| ^JI5HO...| ^JI5HO...| ^JI5HO...| ^Docum...| 10:08 AM 

Screen 2 displays the same screen as in Screen 1 but now includes the bid 
calculator pop-up that will assist you in placing your bid for Job 1. As you move the 
scroll bar to the right, the bottom three boxes will indicate that bid’s value in Gamebucks 
that that position of the scroll bar reflects, the corresponding Total Score (out of 100 
possible points) that bid generates, and translate that bid in terms of U.S. Dollars that you 
would earn if you were to submit that bid and be assigned that job. Once you are 
satisfied with a particular bid, click on the “Save Bid” button and the pop-up bid 
calculator will disappear and you may select another job on which to bid. Once you have 
placed a bid on all the jobs and are satisfied with your bids, click on the “Submit All 
Bids” button displayed in Screen 1. At this point you must wait until all bids from the 
participants have been submitted and the results made available. 


57 







































































How Your Bids Affect Your Assignment 

In each auction you will be presented with 5 jobs on which you may bid. You 
will be competing with 5 other bidders (6 total) for these jobs. Your Total Score affects 
your assignment. The higher your Bid, the lower is your Total Score. In each of the 
several auctions in which you participate, the weight on your Bid is 80% and the weight 
on your Fitness Score is 20%. This means that you may receive as many as 80 points for 
your bid and 20 points for your Fitness Score. The highest value that your Total Score 
could be is 100 points. If your Bid were 0 Gamebucks, then you will receive all 80 points 
for the bid component of your Total Score. On the other hand, if your bid were 100 
Gamebucks, which is the maximum allowable number of Gamebucks, then you will 
receive 0 points toward your Total Score. The remaining 20 possible points come from 
your Fitness Score. You will be randomly assigned a number ranging from 0 to 20 for 
your Fitness Score for each job. This means that 1/5 of your Total Score is unaffected by 
your bid. For each auction the software will then make the assignments that generate the 
maximum possible sum of Total Scores across all assignments. An illustrative example 
is given at the end. 

How Your Payments Are Calculated 

You will receive $15 U.S. Dollars of Game Money that you may think of as 
“working capital” that you can either add to or lose in the following manner. Note that 
this $15 is already reflected in the “Cumulative payment to date (including Game 
Money)” figure tabulated at the end of each auction and displayed as in Screen 3. In the 
example case given, if all the auctions were completed, then your total payment upon 
leaving the experiment would be the $16.00 (as indicated on Screen 3). 

In each auction the Game Money may be added to or lost in the following 
manner. Suppose that based on the above calculations you have been assigned to Job 2 as 
shown in Screen 3. Furthermore, assume that your bid was 35 Gamebucks. Since your 
“My Minimum Bid” was 25 Gamebucks, that means that your profit is 10 Gamebucks 
(i.e. 35-25 = 10). You may exchange that profit in Gamebucks for U.S. Dollars at a rate 
of U.S. Dollar/Gambuck = 0.10. Thus, your earning from that auction is $1.00 (i.e. 0.10 
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X 10 = 1.00) in U.S. Dollars. As shown in Screen 3, after eaeh auction the software will 
update your eumulative payment to date (ineluding Game Money) in U.S. Dollars to 
refleet the outcome of the last auetion. On the other hand suppose that you were not 
assigned any job. In this ease $0.30 will be subtraeted from your cumulative payment to 
date figure as tabulated in Sereen 3. 

Bidding less than your “My Minimum Bid” is highly diseouraged in this auetion. 
If you bid below your “My Minimum Bid” this inereases the likelihood that you will be 
assigned that job and if you were assigned that job you will lose money. For instance, if 
your bid were 20 Gamebueks and “My Minimum Bid” were 40 Gamebueks then you lose 
20 Gamebueks or $2.00 U.S. Dollars (i.e. 20x0.10 = 2.00). In this case $2.00 (U.S. 
Dollars) is subtraeted from your cumulative payment to date figure. 

Screen 3 



Information Provided to Inform Your Bids 
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On the right hand side of both Screens 1 and 2 for each of the 5 jobs you will see 
a table titled “All Possible Minimum Bids.” This table indicates that for the 5 jobs in this 
auction there are 10 rows from which one row is randomly selected (with replacement) 
for each bidder. The row highlighted is the one randomly selected for you for this 
auction. In subsequent auctions another random selection will be made for you. 
Although you do not know the row that is selected for your competitors, you do know all 
the possible rows from which they are randomly drawn. Furthermore, for each job you 
know whether or not your “My Minimum Bid” is above or below the average of all 
possible values. For instance, you know that for Job 1, your “My Minimum Bid” is 25, 
which is slightly greater than the average of 24. 

Similarly, on the right hand side of both Screens 1 and 2 for each of the 5 jobs 
you will see a table titled “All Possible Fitness Scores (max 20).” Recall that the Fitness 
Score contributes to your Total Score as well. Your randomly selected (with 
replacement) row is highlighted in yellow. Other bidders will also be given a randomly 
selected a row for their Fitness Scores. The other bidders’ rows may be different than 
yours. Again, the averages for each job are presented at the bottom so that you have 
some idea whether your Fitness Score is likely to be better or worse than the average. 

You may want to refer to this information when determining how to set your bids 
for each of the available jobs. From this information you may be able to draw some 
inferences about what your competitors’ bids are likely to be. Since other participants’ 
bids affect your assignment, this information may be helpful, but you are not required to 
refer to it when determining your bids. 

How Assignments are Determined - A Simple Example 

To illustrate how the software will select who is assigned to a particular job, and 


Table 1 



Job 1 Job 2 I 

Bidder 1's Total Score 

Bidder 2's Total Score 
Bidder 3's Total Score 
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who is not assigned at all, let’s take a simple 2-job, 3-bidder seenario. The below 
Table 1 indicates the 2 Total Scores for each of the 3 bidders. Given that there are 3 


Table 2 


Assignment 

Set 


Job 1 

Total Score 


Job 2 

Total Score 


Sum of the 

Total Scores 

1 


Bidder 1 60 


Bidder 2 50 


60+50= 110 

2 

Bidder 1 60 

Bidder 3 55 

60+55= 115 

3 

4 

5 

6 


Bidder 2 50 

Bidder 2 50 

Bidder 3 30 

Bidder 3 30 


Bidder 1 62 

Bidder 3 55 

Bidder 1 62 

Bidder 2 50 


50+62= 112 
50+55= 105 
30+62= 92 

30+50= 80 


bidders and 2 jobs, there are 6 possible ways to determine the Assignment Set. The 
software calculates the Sum of the Total Scores for all 6 possible sets of assignments and 
then picks the one with the largest Sum of the Total Scores. No bidder will be assigned 
to more than one job per auction. In case of a tie the Assignment Set is randomly 
selected from those that offer the largest Sum of the Total Scores. 

Table 2 displays the Sum of the Total Scores for all Assignment Sets and 
highlights Assignment Set 2 as that is the one that generates the largest Sum of the Total 
Scores (60 + 55 = 115). Accordingly, Bidder 1 is assigned to Job 1, Bidder 2 is 
unassigned, and Bidder 3 is assigned to Job 2. 

Payout in the Event of a Major Software Malfunction 

This software has been tested extensively but in the event of a software 
malfunction that precludes the determination of the your proper payout, then you will be 
given $30 for your participation. The determination of whether there has been a major 
software malfunction will be made by the experiment administrators. 
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APPENDIX C 


JASS DISPLAYS OF AIP 


JASS Displays of AIP 






Click on below options: 


► Enter Enlisted JASs 

► 5 5 Format Requisition Fill 

► EnterTeam Detailing 

► Download ATSEA 5.5 Client 

» Fi lejrriansfer 

► Team Detailing File Transfer 

► Change Password 

► Log Out 

►Submit Feedback on WEB JASS 


Atl users: please submit feedback by ctickirtg 
llte abave eptiet*. Yeur feedback and 
recommendations are important to identily any 
prebtems andi make improvements to WEB 
JASS. 


4- - ^ ^ ^ I ^ - 3 


Initial view of “Review 
Jobs and Make 
Application ” page 


I Hom« I 


Edit/Rev lew I Results 1 Notes 1 DATA XFER I Log Out | 


Review Jobs and Make Auplications 


Download Current Requisition for JASS Client 


OOWNLOAO 


MOT 


Required Inpul 


Requisition Date: 10/1D 


MCA 
r BUPER3 
r~ Atlantic 
r~ Pacific 
r~ Reserve 

Location: 


Special Programs and Communities: 


Zj Pay Grade: 11 ^ l-l 9 "^1 


Composite 

r~ Sea 
r~ Eliore 
r~ Sub Sea 
D Sub Shore 


Localion 


UlC 


MEC 



Unit Type: |AII Units 


JTob Category: 


jg G2K Ogions 


n Incentive | 
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WB& 


^^ 4 ff 

I Home m3l bdtt^Rgview | Results | Motss | 


Review Jobs and Make A 


Down]oad Currem Requisition for JASS Client: 


RetjutreiJ Input 


Optional Input 


MCA 

neuPERS 

Atlantic 
1“ Pacific 
I” Reserve 


Requisition Date: 111/19 


I 


Special Programs and Communiti 


Composite 
p' Sea 
I” Shore 
1“ Sub Sea 
I” Sub Shore 


4ej63j63 


Location: |AJI Locations 


Job Category: ^ 


Checking this 
box identifies 



[Click on Activity Name to view details of job and proceed to application screen] 

Jobs Found: 5^ Displaying 1-S of 3 

rcw 
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